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A  Seasonal  Skill  Comparison  between  Operational  Ocean 
Thermal  Stmctnre  Products  in  the  Northeast 
Atlantic/Norwegian  Sea 


ABSTRACT 

The  U.S.  N-  ivy’s  Fleet  Numerical  Oceanospraphy 
Center  has  several  operational  products  avail¬ 
able  fvr  thermal  structure  nowcasts  in  the 
northeast  Atlantic/Norwegian  Sea.  These 
include  regional  nowcasts  and  short  forecasts 
at  40  km  resolution,  global  nowcasts  and  short 
forecasts  at  190  km  resolution,  and  two  ther¬ 
mal  dimatologies  at  50  km  and  380  km  resolu¬ 
tions.  We  propose  two  hypotheses:  (1)  that  the 
inclusion  of  real-time  data  in  the  nowcasts  and 
forecasts  improves  nowcast  skill  over  the  use  of 
dimaudogy  alone  and  (2)  that  increased  real¬ 
time  product  resolution  increases  nowcast 
skill.  This  study  addresses  these  hypotheses  by 
comparing  the  six  products  listed  above  in  the 
northeast  Atlantic/Norwegian  Sea  region  on  a 
seasonal  basis. 

We  extracted  daily  bathythermograph 
(BT)  data  from  the  real-time  operational 
database  in  a  2,000  km  diameter  region  cen¬ 
tered  on  the  Iceland-Faeroe  Front  from  July 
1989  through  June  1990.  We  then  compared 
each  BT  to  the  spatially-interpolated  results 
from  each  of  the  six  operational  products.  All 
comparisons  were  made  prior  to  the  BTs 
assimilation  into  the  real-time  products.  For 
each  season,  we  then  accumulated  three 
monUis  of  results  to  form  a  root-mean-square 
deviation  of  a  given  product  rdative  to  the 
verifying  BTs. 

In  this  region,  the  results  indicate 
that  the  real-time  nowcasts  perform  better  than 
both  climatologies  in  autumn  and  winter.  The 
results  also  demonstrate  the  advantage  of 
increased  resolution  in  fall  and  tvinter,  but  not 
as  strongly.  The  spring  and  summer  results  do 
not  produce  definitive  conclusions. 

INTRODUCTION 

leet  Numerical  Oceanography  Center 
(FNOC)  is  the  U.S.  Navy’s  production  center 
for  global-scale  and  open-ocean  regional-scale 
oceanographic  products.  FNOC  produces  many 
real-time  nowcasts  and  forecasts  of  ocean  ther¬ 
mal  structure  on  a  daily  basis.  These  products 
range  from  the  global  domain  at  190  km  resolu¬ 
tion  down  to  specific  regions  at  20  km  resolu¬ 
tion  and  serve  a  number  of  military  and  civilian 
uses.  They  can  provide  the  following;  (1)  three- 
dimensioruil  thermal  structure  for  input  to 
acoustic  propagation  models  used  in  anti-sub¬ 
marine  warfare,  (2)  surface  boundary  conditions 
for  operational  atmospheric  models,  (3)  front 
and  eddy  locations  and  vertical  thermal  struc¬ 
ture  for  fisheries  applications,  and  (4)  a  thermal 


history  of  the  ocean  for  use  in  global  climate 
studies. 

FNOC  has  a  suite  of  products  that  can 
be  applied  to  the  above  purposes  (Clancy  and 
Sadler,  1992).  The  most  appropriate  of  these 
depends  on  the  question  being  asked.  One  might 
pose  the  specific  question,  ‘What  is  the  best 
product  to  represent  today’s  thermal  structure?’ 
In  the  Norwegian  Sea  area,  six  different  thermal 
structure  products  are  available  that  might  be 
chosen  as  the  ‘best’  nowcast  representation. 
These  include  global  and  regional  nowcast  prod¬ 
ucts  (specifically  designed  for  nowcasts),  global 
and  regional  short  forecast  products,  and  two 
different  climatologies.  Given  this  choice  of 
products,  the  imperative  for  objective  measures 
of  relative  skill  becomes  obvious. 

Previous  comparisons  of  uitassimilated 
thermal  data  with  a  Mediterranean  regional  and 
a  global  nowcast  indicate  that  (1)  both 
Mediterranean  and  global  nowcast  products  per¬ 
form  better  than  the  global  climatology  (Clancy 
et  al.,  1986;  Clancy  et  al.,  1992)  and  (2)  increased 
resolution  provides  significant  improvement  to 
nowcast  sl^  (Clancy  et  al.,  1992).  Harding  et  al. 
(1991)  report  similar  results  in  the  northeast 
Atlantic/Norwegiaiv  Sea  regioii  for  the  February/ 
March/^ril  1990  period  using  the  six  opera¬ 
tional  products  listed  above. 

This  present  study  extends  this  last 
work  by  examining  the  data  available  from  July 
1989  though  June  1990  to  derive  a  seasonal  pic¬ 
ture  of  the  relative  nowcast  skill  of  the  six  prod¬ 
ucts  in  the  northeast  Atlantic/Norwegian  Sea. 
The  results  of  this  study  also  provide  a  statistical 
benchmark  for  planned  future  product  improve¬ 
ments  in  this  region. 

APPROACH 

Region 

The  northeast  Atlantic/Norwegian  Sea 
region  (Figure  1)  provides  a  relevant  as  well  as 
challenging  environment  for  evaluating  real-time 
ocean  thermal  structure  products.  The  area  sup¬ 
ports  m^or  fisheries,  includes  m^or  transit 
routes  for  military  and  civilian  shipping,  and 
provides  the  source  of  much  of  northern 
Europe’s  weather. 

The  Norwegian  Sea  alone  is  an 
extremely  complex  area  as  detailed  by  Hopkins 
et  al.  (1986).  It  is  essentially  an  intermediate 
ocean  that  couples  the  Arctic  and  Atlantic 


PAPER 


J.  M.  NanfMg 

Naval  Research  Laboratory, 
Stennis  Space  Center. 
Mississippi 

F.Mar 

Ocean  Models  Division 
Fleet  Numerical 
Oceanography  Center 
Monterey,  California 

K.  0.  Poliak 

Ocean  Models  Division 
Fleet  Numerical 
Oceanography  Center 
Monterey.  California 

R.M.aaoef 

Ocean  Models  Division 
Fleet  Numerical 
Oceanography  Center 
Monterey.  California 


MTS  Journal 


VoL  26.  No.  2  •  IS 


FI6UWE 1  ■  Geographic  area. 


oceans.  Warm,  saline  North  Atlantic  water  mixes 
with  cold,  fresh  Arctic  Ocean  water  resulting  in 
deep  water  formation  and  numerous  topographi¬ 
cally  anchored  ocean  fronts.  Dynamic  instabili¬ 
ties  along  these  fronts  spawn  numerous  eddies 
in  the  region. 

Interacting  with  this  complex  oceanog¬ 
raphy  is  the  equally  complex  meteorology  of  the 
region.  The  climatological  division  of  the  atmo¬ 
spheric  polar  easterlies  and  the  mid-latitude 
westerlies  (the  Arctic  front)  runs  approximately 
southwest  to  northeast  along  a  line  from  Iceland 
through  Bear  Island.  This  line  roughly  coincides 
with  the  topographic  division  of  the  Norwegian 
Sea  by  the  mid-Atlantic  Ridge  and  a  mqjor  ocean 
frontal  division  between  waters  of  Atlantic  and 
Arctic  origin.  The  northwestern  Norwegian  Sea, 
often  called  the  Greenland  Sea,  is  dominated  by 
northeasterly  winds  related  to  Arctic  high  pres¬ 
sure.  These  tend  to  weaken  somewhat  in  sum¬ 
mer.  The  southeastern  Norwegian  Sea  is  subject 
to  a  sequence  of  northeastward  moving  cyclones 
related  to  the  climatological  Icelandic  low. 

These  decrease  in  strength  and  frequency  in 
spring  and  summer  as  the  Icelandic  low  begins 
to  rapidly  frU  and  the  polar  high  builds  in  March. 
The  filling  of  the  Icelandic  low  corresponds  to 
the  decreasing  sea-surface  temperature  gradient 
between  waters  north  and  south  of  Iceland. 


Cyclone  strength  and  frequency  again  increase 
in  the  fall  with  the  increased  north  to  south 
increase  in  temperature  gradient  and  the  associ¬ 
ated  renewed  deepening  of  the  Icelandic  low. 

Models 

The  six  thermal  structure  products 
available  in  the  Norwegian  Sea  area  are  as  fol¬ 
lows:  (1)  the  FNOC  global  climatology,  (2)  the 
Generalized  Digital  Environmental  Model 
(GDEM)  climatology,  (3)  the  regional  Expanded 
Ocean  Thermal  Structure  (EOTS)  real-time  now- 
cast  product,  (4)  the  global  Optimum  Thermal 
Interpolation  System  (OTIS)  real-time  nowcast 
product,  (5)  the  regioiral  Thermodyiramic  Ocean 
Prediction  System  (TOPS)  real-time  forecast 
product,  and  (6)  the  global  TOPS  real-time  fore¬ 
cast  product 

The  two  climatologies  provide  histori¬ 
cally  averaged  thermal  structure  properties. 

The  FNOC  global  climatology  (Weigle  and 
Mendenhall,  1974)  is  available  monthly  on  hemi¬ 
spheric  polar  stereographic  grids  at  380  km  reso¬ 
lution.  The  GDEM  (Teague  et  al.,  1990),  provides 
nearly  global  coverage  at  0.5  degree  resolution. 
GDEM  is  available  monthly  at  the  surface  and 
seasonally  below. 

The  two  real-time  nowcast  products 
use  objective  analysis  techniques  designed  to 
combine  the  available  real-time  satellite,  ship, 
buoy,  and  bathythermograph  data  with  climato¬ 
logical  fields  to  provide  a  representation  of  ther¬ 
mal  structure  in  the  upper  400  m  at  a  specific 
time.  The  EOTS  model  (Holl  et  al.,  1979),  based 
on  the  fields-by-information-blending  techmque, 
currently  runs  daily  in  a  region  covering  the 
Norwegian  and  Greenland  Seas  and  northeast 
Atlantic  with  grid  resolution  of  -40  km.  The 
Norwegian  Sea  EOTS  uses  the  GDEM  in  its  first 
guess  initializabon  process. 

The  regional  (TTIS  (Cummings  and 
Ignaszewski,  1991),  based  on  optimal  estimation 
theory,  is  designed  to  eventually  replace  region¬ 
al  EOTS.  Presently  in  the  Norwegian  Sea  region, 
however,  only  the  global  OTIS  product  is  avail¬ 
able  on  a  polar  stereographic,  - 190  km  grid  for 
the  upper  400  m.  The  global  OTIS  uses  the  coars¬ 
er  resolution  FNOC  global  climatology  as  its 
first  guess  field.  Each  of  these  nowcast  prod¬ 
ucts,  EOTS  and  OTIS,  provides  initial  conditions 
for  the  TOPS  daily  forecasts  for  their  respective 
regions. 

TOPS  is  an  oceanic  mixed-layer  fore¬ 
cast  model  (Clancy  and  Martin,  1981,  Clancy  and 
Poliak,  1983:  Martin  et  al.,  1985;  Harding  and 
May,  1989)  designed  to  forecast  the  direct  atmo¬ 
spherically  forced  changes  in  the  upper-ocean 
temperature  and  current  structure.  Forced  by 
the  Navy  Operational  Global  Atmospheric 
Prediction  System  (NOGAPS)  (Hogan  et  al., 
1991),  TOPS  forecasts  nm  daily  (36  hr  in  the 
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Norwegian  Sea,  72  hr  global).  The  previous  day's 
TOPS  24  hr  forecasts  feed  into  a  given  EOTS 
(Norwegian  Sea)  or  OTIS  (global)  nowcast  pro¬ 
viding  upper-ocean  infoimation  especially  in 
data-sparse  areas. 

Elzperimental  Design 

Consistent  with  the  results  of  the  stud¬ 
ies  related  earlier,  we  propose  two  hypotheses. 
First,  the  real-time  products  will  demonstrate 
more  nowcast  skill  than  the  historically  derived 
climatologies.  This  improvement  in  skill  should 
occur  if  the  inclusion  of  real-time  data  does 
indeed  provide  a  better  description  of  the  true 
temporal  variability  of  the  ocean.  Real-time  data, 
badly  aliased  in  space  or  time,  would  degrade  a 
nowcast  compared  to  climatology.  Second,  the 
higher  resolution  real-time  products  will  provide 
more  skillful  nowcasts  than  the  global  products. 
These  improved  nowcasts  should  result  from 
better  resolution  of  the  inherent  spatial  variabili¬ 
ty  of  the  ocean.  We  must  also  note  an  uncon¬ 
trolled  confounding  variable  in  testing  of  the 
second  hypothesis.  Previous  work  (Clancy  et  al., 
1990)  indicates  that  OTIS  provides  more  skillful 
retU-time  nowcasts  than  EOTS  when  ^pUed  to 
equal  grids.  Thus,  the  improvements  expected 
by  the  higher  resolution  EOTS  products  may  be 
partially  or  completely  negated  by  the  advan¬ 
tages  of  using  OnS  for  the  coarser  grid. 

To  test  the  above  hypotheses,  we  sam¬ 
pled  the  available  models  using  the  process 
schematically  outlined  in  Figure  2.  At  noon 
Greenwich  mean  time  (GMT)  of  day  n,  we  saved 
the  accumulated  BTs  firom  the  previous  12  hrs. 
As  a  baseline  measure,  an  EOTS  nowcast  (NWC) 
that  includes  the  BT  data  occurred.  The  NWC 
profiles  at  the  BT  positions  were  extracted  and 
saved.  The  profiles  from  the  climatologies,  tem¬ 
porally  interpolated  to  12  GMT  on  day  n,  were 
taken  from  both  the  FTIOC  climatology  (CLF) 
and  GDEM  climatology  (CLG).  Likewise,  the 
profiles  at  each  BT  position  are  extracted  from 
(1)  the  global  OTIS  fix>m  12  hrs  earlier,  namely  a 
12-hr  persistence  forecast  (P12)  and  (2)  the 
global  TOPS  forecast  initialized  12  hrs  earlier 
(F12).  Both  of  these  forecasts  would  be  valid  at 
noon  GMT  at  day  n.  The  regional  products  were 
also  sampled,  though  from  24  hrs  eariier.  The 
day  n-1  EOTS  represented  a  24-hr  persistence 
forecast  (P24)  and  TOPS,  a  24-hr  model  forecast 
(F24). 

For  this  study,  we  accumulated  this 
daily  data  for  the  months  from  July  1989  through 
June  1990.  We  sampled  within  a  1,000  km  radius 
circle  centered  between  Iceland  and  the  Faeroe 
Islands  (Figure  1).  We  divided  the  twelve 
months  of  data  into  three-month  groups  repre¬ 
senting  nominal  seasons.  July,  August,  and 
September  represent  summer.  October, 
November,  and  December  represent  autumn. 


naUBE  2.  Schematie  ot  temporal  sampling. 


DAY  n*1 


DAY  n 


OQMT  12QMT  0  GlfT  12  GMT  0  GMT 

I —  data — I 
window 


F»24  P12  NWC 

F24  F12  CLF 

CLG 

NWC  -  Nowcast:  Norwegian  Sea  EOTS  (40  Km) 
CLF  -  Climatology:  global  FNOC  (380  km) 

CLG  -  Climatology:  global  GDEM  (50  km) 

P12  -  12  hr  Persistence:  global  OTIS  (190  km) 

P24  -  24  hr  Persistence:  regkxial  EOTS  ( 40  km) 

F12  -  12  hr  Forecast:  global  TOPS  (190  km) 

F24  -  24  hr  Forecast:  regional  TOPS  ( 40  km) 


January,  February,  and  March  represent  winter. 
And  April,  May,  and  June  represent  spring.  We 
then  computed  three-month,  cumulative  statis¬ 
tics  including  mean,  standard  deviation,  mean 
error  (ME),  mean  absolute  error,  and  systemat¬ 
ic,  unsystematic,  and  total  root  mean  square 
error  (RMSE)  (Willmott,  1981, 1982;  Willmott  et 
al.,  1985).  For  the  purposes  of  this  paper,  we 
focused  on  the  total  RMSE  as  the  primary  error 
measure.  Due  to  the  unknown  distribution  of  the 
population,  we  employed  a  bootstrap  technique 
(WUlmott  et  al.,  1985)  to  calculate  R^E  90  per¬ 
cent  coididence  limits. 


RESULTS 


Figure  3  illustrates  the  data  distribution  for 
each  of  the  four  seasons.  Sample  sizes  for 
each  season  are  109  for  winter,  58  for  spring,  158 
for  siunmer,  and  129  for  autumn.  The  regular 
sampling  at  Ocean  Station  Lima  appears  as  the 
high  density  pattern  around  57®N  and  20’’W. 

Note  that  the  sample  sizes  are  subsets  of  the 
actual  data  available  to  the  real-time  analyses. 
Winter,  summer,  and  autumn  samples  are  about 
70  percent  of  the  total  available  unclassified 
data.  The  spring  sample  is  about  45  percent  of 
the  available  data.  These  reduced  samples  occur 
due  to  diUa  transmission  losses  between  FNOC 
and  the  Naval  Research  Laboratory.  Also  for  this 
particular  year  and  in  this  region,  the  BT  data 
return  drops  off  dramatically  below  150  m.  We 
therefore  limited  the  comparisons  to  the  upper 
150  m  of  the  water  colunui. 

Table  1  lists  the  RMSE  figures  includ¬ 
ing  the  90  percent  confidence  limits  for  all  six 
products.  Figure  4  shows  the  RMSE  for  the 
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FI6URE  3.  Data  distribution  for  (clockwise  from  upper  left)  winter,  spring,  autumn,  and  summer. 


various  products  with  depth.  All  reported  values 
for  RMSE  in  this  paper  are  in  units  of  degrees 
Celsius.  We  dropped  the  two  forecast  products 
from  the  graphical  presentation  since  they  are 
essentially  equivalent  to  the  nowcast  results  for 
their  respective  horizontal  resolutions.  We 
expected  this  since  the  forecast  results,  as  used 
here,  do  not  provide  temporal  interpolations  to 
the  BT  sampling  time.  Referring  to  Figure  2,  P24 
should  be  best  at  12  GMT  on  day  n-1,  should 
be  best  at  12  GMT  on  day  n.  The  various  BTs 
used  as  comparison,  however,  are  temporally 
scattered  between  0  GMT  and  12  GMT  on  day  n. 
The  P12  and  F12  are  sinularly  at  either  end  of 
the  sampling  period.  Fliture  validation  tests 
using  the  forecast  model  output  at  the  individual 
BT  samplirtg  time  ^ould  clarify  this  issue. 

The  autumn  and  winter  results  from 
this  study  clearly  support  our  first  hypothesis 
that  real-time  products  perform  better  than  both 
climatologies.  The  RMSE  values  for  both  the 


GDEM  climatology  (CLG)  and  the  coarser  reso¬ 
lution  FTIOC  climatology  (CUO  generally  rattge 
from  -1.3  at  the  surface  to  -1.0  at  depth  in  win¬ 
ter.  In  autumn,  CLG  performs  better  than  CLF. 
CLP  rartged  from  -1.4  at  the  surface  to  -1.6  at 
depth  while  CLG  ranged  from  -1.1  at  the  surface 
to  -0.8  at  100  m  and  below.  The  highest  real¬ 
time  product  errors  (P12)  ranged  from  -1.0  at 
the  surface  to  -0.8  at  depth  in  winter,  and  from 
-0.7  at  the  surface  to  -0.8  at  depth  in  autumn. 
Only  below  75  m  in  autumn  does  CLG  approach 
the  skill  (within  the  00  percent  confidence 
bounds)  of  the  real-time  products. 

In  spring  and  summer,  the  results  are 
less  clear-cut  The  spring  results  all  cluster 
together  tanging  from  -0.7  at  the  surface  to  -1.0 
at  depth  for  all  the  products.  For  the  summer, 
the  regional  P24  performs  better  than  the  coars¬ 
er  resolution  CLF  below  60  nt  However,  the 
higher  resolution  climatology,  CLG,  tracks  very 
closely  with  P24.  The  interesting  feature  of  the 
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RGIfflE  4.  Root-mean-square  error  {“  Celsius)  versus  depth  (m)  in  Iceland/Faeroe  repion  for  (clockwise  from  upper  left) 
wimer,  spring,  autumn,  and  summer.  NWC.  P12.  P24.  CLF.  and  CLG  refer  to  operational  products  defined  in  the  text  and  in 
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summer  plots  is  the  strong  increase  in  RMSE  at 
50  to  75  m.  This  depth  range  coincides  with  the 
seasonal  thermocline  for  this  area  in  summer 
(Hopkins,  1988).  The  high  errors  at  depth  reflect 
the  inability  of  any  of  the  existing  products  to 
resolve  the  temporal  and/or  spatial  variability  of 
the  seasonal  thennocline.  The  forecast  models, 
when  used  to  temporally  interpolate  to  the  sam¬ 
ple  time,  should  resolve  the  wind-induced  mixed 
layer  variability.  This  particular  capability,  how¬ 
ever,  is  not  tested  by  this  experiment  and 
requires  future  study. 

Above  100  m,  the  autumn  and  winter 
results  also  support  the  second  hypothesis  that 
improved  resolution  of  the  real-time  product 
improves  nowcast  skill.  The  winter  regional 
nowcast  (P24)  RMSE  is  -0.8  from  surface  to  bot¬ 
tom.  compared  to  the  coarser  resolution  P12, 


which  ranges  from  -1.0  at  the  surface  to  -0.8  at 
depth.  Autumn  RMSE  ranges  from  -0.6  at  the 
surface  to  -0.8  at  depth  for  P24  compared  to 
-0.7  at  the  surface  to  -0.8  at  depth  for  P12.  This 
result  is  not  as  definitive  as  that  with  the  clima¬ 
tology  comparison  since  the  confidence  levels 
must  be  dropped  to  about  70  percent  to  ensure 
statistical  significance.  The  enhanced  skill 
expected  from  increased  resolution  is  likely 
opposed  by  the  increased  skill  of  OTIS  versus 
EOTS  (Clancy  et  al.,  1990)  as  discussed  earlier. 

In  spring  and  summer,  the  results  are 
once  again  mixed.  In  spring  none  of  the  prod¬ 
ucts  exhibit  an  advantage  over  another  as  relat¬ 
ed  above.  In  summer,  the  higher  resolution 
regional  product  P24  exhibits  -0.3  degree  RMSE 
improvement  over  the  global  P12  at  the  surface 
and  at  depth.  However,  the  scatter  of  the 
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TAILE 1.  Data  for  Figure  4  including  90  percent  confidence  bounds  UL  =  upper  limit. 
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distribution,  as  represented  by  the  large  enxir 
limits  (Table  1),  preclude  any  statement  on  the 
significance  of  this  difference.  The  errors  for  the 
two  products  converge  at  the  base  of  the  mixed 
layer,  again  highlighting  the  difficulty  of  repre¬ 
senting  the  seasonal  thermocline. 

In  general,  the  importance  of  real-time 
data  and  resolution  in  the  autumn  and  winter 
results  is  not  apparent  in  the  spring  and  summer. 
This  difference  coincides  with  the  seasonal  shift 
in  atmospheric  forcing.  The  incidence  and  be- 
quency  of  cyclones  decreases  significantly  while 
solar  heat  flux  and  resultant  upper-ocean  stratifi¬ 
cation  increases  in  the  spring  and  summer 
(Hopkins  et  al.,  1986).  This  result  suggests  that 
the  variability  in  the  upper-ocean  signal,  reflect¬ 
ed  in  the  rerd-time  data  products  in  autumn  and 
winter,  is  atmospherically  forced  and  dominant 
only  in  the  autumn/winter  period. 

CONCLUSIONS 

The  autumn  and  winter  results  of  this  season¬ 
al  study  in  the  northeast  Atlantic/Norwegian 
Sea  support  previous  FNOC  ocean  thermal  prod¬ 
uct  validation  work  demonstrating  (1)  the  statis¬ 
tically  significant  improvement  of  the  real-time 
products  over  climatology  and  (2)  the  improve¬ 
ments  arising  ht>m  increased  resolution  of  the 
real-time  products.  Results  from  the  spring  and 
summer  are  inconclusive.  Spring  and  summer 
also  coincide  with  reduced  incidence  and 
strength  of  cyclones  in  the  area.  The  difference 
between  autumnAvinter  and  spring/sununer 
results  suggest  that  the  variability  in  the  upper- 
ocean  signal  resolved  by  the  real-time  products 
is  atmospherically  driven  and  dominant  only  in 
the  autunuiAvinter  period.  Summer  results  also 
imply  limitations  in  all  the  products  in  represent¬ 
ing  the  seasonal  thermocline  as  greater  solar 
heat  flux  increases  upper-ocean  stratification. 

The  overall  results  provide  a  valuable 
quantitative  benchmark  for  proposed  upgrades 
to,  or  replacements  of.  existing  operational  ther¬ 
mal  structure  products.  In  addition,  they  provide 
an  operational  frame  of  reference  for  research 
studies  in  the  Norwegian  Sea  region,  such  as  the 
receru  international  Greenland-Iceland- 
Norwegian  (GIN)  Sea  experiment  (G.  Hebum, 
personal  communication). 

This  study  supports  three  m^or  recom¬ 
mendations.  First,  that  FNOC  should  institute 
real-time  monitoring  of  the  skill  of  all  opera¬ 
tional  thermal  structure  products  comparable  to 
that  done  for  the  global  OTIS  (Clancy  et  al., 

1992)  and  Gulf  Stream  regional  OTIS  (Cummings 
and  Ignaszewski,  1991).  This  allows  ongoing 
product  skill  assessments  for  all  the  available 
operational  products.  Second,  in  this  ongoing 
skill  assessment,  FNOC  should  include  the  oper¬ 
ational  mixed-layer  forecast  products  (including 
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longer  forecasts  as  weU)  extracted  at  the  actual 
BT  sample  time.  This  would  allow  a  presently 
unavailable,  ongoing,  quantitative  measure  of 
skill  for  the  (q>erational  forecast  products.  Third, 
research  into  four-dimensional  data  assimilation 
using  dynamic  ocean  models  and  coupled  atmo¬ 
sphere/ocean  models  is  needed.  This  research 
would  allow  better  representation  of  the  dynam¬ 
ic  processes  affectiiig  the  upper-ocean  so  that 
these,  too,  can  be  included  in  future  operational 
products. 
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